Learning Interactive Affordance for Human-Robot Interaction

نویسندگان

  • Tianmin Shu
  • M. S. Ryoo
  • Song-Chun Zhu
چکیده

In this paper, we present an approach for robot learning of social affordance from human activity videos. We consider the problem in the context of human-robot interaction: Our approach learns structural representations of human-human (and human-object-human) interactions, describing how body-parts of each agent move with respect to each other and what spatial relations they should maintain to complete each sub-event (i.e., sub-goal). This enables the robot to infer its own movement in reaction to the human body motion, allowing it to naturally replicate such interactions. We introduce the representation of social affordance and propose a generative model for its weakly supervised learning from human demonstration videos. Our approach discovers critical steps (i.e., latent sub-events) in an interaction and the typical motion associated with them, learning what body-parts should be involved and how. The experimental results demonstrate that our Markov Chain Monte Carlo (MCMC) based learning algorithm automatically discovers semantically meaningful social affordance from RGB-D videos, which allows us to generate appropriate full body motion for an agent.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Object-object interaction affordance learning

This paper presents a novel object–object affordance learning approach that enables intelligent robots to learn the interactive functionalities of objects from human demonstrations in everyday environments. Instead of considering a single object, we model the interactive motions between paired objects in a human–object–objectway. The innate interaction-affordance knowledge of the paired objects...

متن کامل

Learning Social Affordance for Human-Robot Interaction

In this paper, we present an approach for robot learning of social affordance from human activity videos. We consider the problem in the context of human-robot interaction: Our approach learns structural representations of human-human (and human-object-human) interactions, describing how body-parts of each agent move with respect to each other and what spatial relations they should maintain to ...

متن کامل

Parental scaffolding as a bootstrapping mechanism for learning grasp affordances and imitation skills

Parental scaffolding is an important mechanism utilized by infants during their development. Infants, for example, pay stronger attention to the features of objects highlighted by parents and learn the way of manipulating an object while being supported by parents. Parents are known to make modifications in infant-directed actions, i.e. use “motionese”. Motionese is characterized by higher rang...

متن کامل

A Visual Servoing System for Interactive Human-Robot Object Transfer

As the demand for close cooperation between human and robots grows, robot manufacturers develop new lightweight robots, which allow for direct human-robot interaction without endangering the human worker. However, enabling direct and intuitive interaction between robots and human workers is still challenging in many aspects, due to the nondeterministic nature of human behavior. This work focuse...

متن کامل

Measurement of Robot Similarity to Determine the Best Demonstrator for Imitation in a Group of Heterogeneous Robots

Imitation is not only a powerful means to drastically downsize the exploration space when learning behavior. It also helps to align the learning efforts of a robot group towards a common goal. However, one prerequisite in imitation, the decision of which robot to imitate, is often factored out in current research. In our work we address this question by providing a means to measure the similari...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016